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VIDEO OVERLAY DEVICE OF MOBILE TELECOMMUNICATION TERMINAL 

5 INVENTOR(S): WOO SEGG PARK 

CRGSS-REFERENCE TG RELATED APPLICATION 

[0001] Pursuant to 35 U.S.C. § 119(a), this application claims the benefit 
of earlier filing date and right of priority to Korean Patent Application No. 2002- 
10 78469, filed on December 10, 2002, the content of which is hereby incorporated by 
reference herein In its entirety. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

15 [0002] The present invention relates to a mobile telecommunication 

terminal, and more particularly, to a mobile telecommunication terminal which can 
display graphic data displayed on a liquid crystal display (LCD) screen of a mobile 
telecommunication terminal. 

20 Description of the Related Art 

[0003] A mobile telecommunication terminal can be utilized to provide 
various functions such as a camera function and a replaying function in addition to 
voice communication functions. The camera function and the multimedia replaying 
function are more popular now that wideband services is available. A mobile 

25 telecommunication terminal may include a high resolution digital cameral and a 
color LCD screen. 
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[0004] On the LCD screen of the mobile telecommunication terminal, 
icons provide certain information such as receiving sensitivity, battery capacity, 
message, bell/ vibration, etc. Certain graphic data for a menu display and video 
input through a camera and streaming video signals decoded by an MPEG-4 
5 codec (coder and decoder) are also displayed. 

[0005] Referring to Figure 1, a block diagram showing a construction of 
a general mobile telecommunication terminal in which various video data can be 
displayed is provided. A general mobile telecommunication terminal comprises a 
central processing unit (CPU) 10; a camera module 102; an MPEG-4 video codec 

10 103, and an LCD 104. The CPU 10 is for controlling each of the above 
components. The camera module 102 is for photographing videos as a digital 
method by using an image sensor, the MPEG-4 video codec 103 is for 
compressing and restoring graphic data inputted from the CPU 101, MPEG-4 
streaming video data, and video data inputted from the camera module. The LCD 

15 104 for displaying the compressed and restored data 

[0006] The MPEG-4 video codec 103 includes a host interface 103^1, a 
camera interface unit 1034, a video processing unit 1032, an arbitration circuit unit 
1033, a memory 1035, and an LCD interface unit 1036. The host interface 1031 
is for giving and taking graphic data and control signals with the CPU 101. The 

20 camera interface unit 1034 is for receiving a digital video signal from the camera 
module 102. 

[0007] The video processing unit 1032 is for compressing the digital 
video signal inputted from the camera module 102 by a standard of the MPEG-4 or 
restoring MPEG-4 streaming data inputted from the CPU 101. The arbitration 
25 circuit unit 1033 is for arbitrating operations of said respective devices and data 
processing processes. The memory 1035 is for storing video data inputted from 



the camera module or video data restored in the video processing unit; and an 
LCD interface unit 1036 for providing data and control signals to the LCD 104. 

[0008] Also included are a first display layer for displaying each kind of 
menu and icon showing various information of the terminal, a second display layer 
5 for video data photographed through a camera module, and a third display layer 
for video data which have restored MPEG-4 video streaming data downloaded 
from a video server. 

[0009] The first layer provides for display for menus, icons, and a 
background screen of the mobile telecommunication terminal. The graphic data is 

10 displayed on the LCD through the host interface 1031, the arbitration circuit unit 
1033, and the LCD interface 1036 on the basis of data showing information of the 
mobile telecommunication terminal provided from the CPU 101 and a clock and a 
synchronization signal required to operate the mobile telecommunication terminal. 
[0010] The second layer provides for display of video data inputted from 

15 the camera module and is to store video data inputted from the camera module 
into the memory 1035 by compressing as one image, or to display inputted video 
data on the LCD 104 in real time. Real time digital R, G, B (red, green, and blue) 
signals inputted from the camera module 102 are displayed on the LCD 104 
through the camera interface 1034, the video processing unit 1032, the arbitration 

20 circuit unit 1033, and the LCD interface 1036. Also, images stored in the memory 
1035 are inputted to the CPU 101 through the arbitration circuit unit 1033 and the 
host interface 1031, compressed into a certain form (for example, JPG), and then 
stored in the memory 1 035. 

[0011] The third layer provides for the display of video data which have 

25 restored the MPEG-4 streaming video data is to display MPEG-4 streaming video 
data inputted from a video server (not shown) by restoring as original video data. 



The inputted video data is inputted to the video processing unit 1032 from the CPU 
101 through the host interface 1031 and the arbitration circuit unit 1033. At this 
time, the video processing unit 1032 outputs the inputted MPEG-4 streaming video 
data by restoring as original video data. Also, the arbitration circuit unit 1033 
5 receives the restored data and displays on the LCD 104 through the LCD interface 
1036. 

[0012] The three display layers have the following problems. When 
graphic data such as icons and the menus and video data are to be displayed, 
icons (play, stop, mute, and etc.) for controlling the video data and information of 

10 the terminal ( for example, receiving sensitivity, battery capacity, and etc.) are 
displayed on an upper side or a lower side of the LCD screen. This limits the 
display area for video display. Alternatively, if the data is displayed on the entire 
LCD screen of the mobile telecommunication terminal in order to solve said 
problem, then the icons and menu information of the terminal corresponding to 

15 graphic data are not displayed. A solution is needed to the above problems and to 
maximize the video display area. 

SUMMARY OF THE INVENTION 

[0013] In accordance with one embodiment, a video overlay device of a 
20 mobile telecommunication terminal comprises a multiplexer for outputting at least 
one of a first video data and a second video data; and a video overlay unit for 
overlaying at least one of the first and second video data with graphic data in 
accordance with a predetermined ratio. The multiplexer selectively outputs at 
least one of the first and second video data based on input video selection signals 
25 provided by a central processing unit (CPU). 

[0014] The video overlay unit comprises a color space convert (CSC) 



unit for converting at least one of the first and second video data into color signals; 
a color look-up data structure comprising information for converting graphic data 
representing device information into color signals; a color palette unit for blending 
video data converted in the CSC unit with graphic data converted based on the 

5 information in the color look-up data structure; and a video selection unit for 
selectively outputting at least one of the first and second video data converted in 
the CSC unit, blended video and graphic data, and the graphic data converted 
based on the color look-up data structure. 

[0015] The color palette unit blends at least one of the first and second 

10 video data with the graphic data according to the predetermined ratio. The 
predetermined ratio is determined based on the video blend signals, provided by 
the CPU. The video selection unit selectively outputs at least one of the first 
video data, the second video data, and the blended video and graphic data. 

[0016] The first video data is provided by a camera module mounted to 

15 the mobile telecommunication terminal. The second video data comprises 
MPEG-4 streaming video data downloaded from a video server. The MPEG-4 
streaming video data is restored using an MPEG-4 codec. 

[0017] In accordance with another embodiment, a video overlay device 
of a mobile telecommunication terminal comprises a central processing unit (CPU); 

20 a camera module for capturing videos; a video codec for compressing and 
restoring streaming video data provided by the camera module; a multiplexer for 
selectively outputting the streaming video data provided by at least one of the 
cameral module and the video codec; and a video overlay unit for overlaying video 
data provided by the multiplexer with graphic data provided by the CPU, according 

25 to a predetermined ratio to produce overlaid data. 

[0018] Some embodiments comprise an LCD interface unit for providing 



the overlaid data to a display device or an LCD for displaying the overlaid data 
provided by the LCD interface unit. The multiplexer selectively outputs the 
streaming video based on video selection signals provided by the CPU. The 
video overlay unit comprises a color space converter (CSC) unit for converting the 

5 video data into color signals. 

[0019] In some embodiments, the video overlay unit further comprises a 
color look-up data structure for converting graphic data associated with terminal 
related information into color signals. The video overlay unit can further comprise 
a color palette unit for blending video data converted in the CSC unit with graphic 

10 data converted according to the predetermined ratio. 

[0020] In some embodiments, a video selection unit is included for 
selectively outputting at least one of the video data converted in the CSC unit, 
blended video and graphic data provided, by the color palette unit, and the graphic 
data converted based on information included in a color look-up data structure in 

15 the video overlay unit. The color palette unit blends at least one of the first and 
second video data with the graphic data according to the predetermined ratio 
provided by the CPU. 

[0021] The predetermined ratio is calculated based on the video blend 
signals provided by the CPU. The video selection unit selectively outputs at least 

20 one of video data provided by the camera module, video data restored through the 
codec, the graphic data, and blended video and graphic data based on selection 
signals provided by the CPU. 

[0022] The camera module digitally captures videos by way of an image 
sensor. The video codec is an MPEG-4 video codec for compressing and 

25 restoring MPEG-4 streaming video data and video data provided by the camera 
module. 



[0023] The present invention is directed to a video overlay device of a 
mobile telecommunication terminal which can overlay graphic data and video data 
by blending graphic data displayed on an LCD screen of a terminal with videos 
inputted through a camera or video data restored by an MPEG-4 codec with a 
5 desired ratio. 

[0024] These and other embodiments of the present invention will also 
become readily apparent to those skilled in the art from the following detailed 
description of the embodiments having reference to the attached figures, the 
invention not being limited to any particular embodiments disclosed. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0025] The accompanying drawings, which are included to provide a 
further understanding of the invention and are incorporated in and constitute a part 
of this specification, illustrate embodiments of the invention and together with the 
15 description serve to explain the principles of the invention. 

[0026] Figure 1 is a block diagram of a mobile telecommunication 
terminal in which a graphic display and a video display are possible in accordance 
with the related art; 

[0027] Figure 2 is a block diagram of a mobile telecommunication 
20 terminal equipped with a video overlay device according to one embodiment of the 
invention; 

[0028] Figure 3 is a block diagram of a minute construction of a video 
overlay unit according to one embodiment of the invention; 

[0029] Figure 4 is an exemplary view for explaining operation 
25 characteristics of each control signal according to one embodiment of the 
invention; 



[0030] Figure 5 is an exemplary view for explaining an output metliod of 
video according to one embodiment of the invention; and 

[0031] Figure 6 is a video blend table showing a video blend ratio 
according to one embodiment of the invention. 
5 [0032] Features, elements, and aspects of the invention that are 

referenced by the same numerals in different figures represent the same, 
equivalent, or similar features, elements, or aspects in accordance with one or 
more embodiments of the system. 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0033] Referring to Figure 2, a mobile telecommunication terminal in 
accordance with one or more embodiments of the invention comprises a central 
processing unit (CPU) 201 ; a camera module 203; an MPEG-4 video codec 204; a 

15 multiplexer 205; a video overlay unit 206; a memory unit 207; an LCD interface 
unit 208; and an LCD 209. The central processing unit (CPU) 201 controls each 
component; the camera module 203 captures videos by using an image sensor; 
the MPEG-4 video codec 204 compresses and restores MPEG-4 (motion picture 
experts group) streaming video data and video data inputted from the camera 

20 module. 

[0034] In some embodiments, the multiplexer 205 outputs video signals 
from the cameral module 203 and the MPEG-4 video codec 204. The video 
overlay unit 206 provides video data from the multiplexer 205 and graphic data 
from the CPU 201 with a predetermined overlay ratio. The memory unit 207 
25 stores the overlaid data. The LCD interface unit 208 is for outputting the overlaid 
data to a display device. The LCD 209 is for displaying data outputted from the 



LCD interface unit 208. 

[0035] In accordance with one embodiment, the CPU 201 controls each 
system component above, including the multiplexer 205, outputs graphic data 
showing information of the mobile telecommunication terminal, and restores the 
5 MPEG-4 streaming, video data through the MPEG-4 codec. This provides the 
output to the multiplexer 205. Also, videos inputted from the camera module 203 
are processed by the MPEG-4 codec 204 and thereby are outputted to the 
multiplexer 205. 

[0036] The multiplexer 205 receives video data from the camera module 
10 203 and the MPEG04 codec 204, and outputs one video data on the basis of 
control signals outputted from the CPU 201 . The video overlay unit 206 blends 
video data outputted from the multiplexer 205 and graphic data outputted from the 
CPU 201 with the predetermined ratio on the basis of control signals outputted 
from the CPU 201. 

15 [0037] The predetermined ratio is calculated based on a basis blend 

table. Also, the blending video data is stored in the memory 207 or outputted to the 
LCD interface 208, in certain embodiments. Accordingly, the LCD interface 208 
receives blending video data from the video overlay unit 206 and thereby displays 
the data on the LCD 209 of the mobile telecommunication terminal. Also, the LCD 

20 interface 208 outputs control signals for controlling the LCD 209 of the mobile 
telecommunication terminal. 

[0038] Referring to Figure 3, the video overlay unit comprises a CSC 
(color space convert) unit 301; a look-up table 302; a color palette unit 303; a 
video selection unit 304, and an LCD interface 305. The CSC (color space 

25 convert) unit 301 converts camera video data outputted through the multiplexer 
205 and restores MPEG-4 video data (16 bits) into color data (R, G, B 24 bits). 



[0039] In some embodiments, the look-up table 302 is provided for 
receiving graphic data from the CPU 201 and thereby converting into color data (R, 
G, B 24 bits). Other data structures can be implemented to provide the same 
service. The color palette unit 303 is for blending video data outputted from the 
5 CSC unit 301 with graphic data outputted from the color look-up table 302 with a 
predetermined ratio. The video selection unit 304 is for selectively outputting one 
of the video data of the CSC unit 301 , the video data of the color palette unit 303, 
and the graphic data of the color look-up table 302. The LCD interface 305 is for 
outputting data outputted from the video selection unit 304 and each kind of 

10 synchronization signal required for an LCD display. 

[0040] Referring to Figure 4, the control signals, i.e., input video 
selection signals (VS_SEL), video blend signals (B_L), and output video selection 
signals (VID_SEL) are respectively outputted through a general purpose input 
output (GPIO) port of the CPU 201 in order to control the multiplexer 205, the color 

15 palette 303, and the video selection unit 304. 

[0041] In one embodiment, the input video selection signals (VS_SEL) 
are inputted to the multiplexer 402. The multiplex selects one of video data 
outputted from the camera module and video data restored through the MPEG-4 
thus to output. The video blend signals (B_L) are inputted to the color palette 

20 4031 in order to control a blend ratio of the video data and the graphic data. 

[0042] The output video selection signals (VID_SEL) are inputted to the 
video selection unit 4032. The video selection unit 4032 selectively outputs one 
data of the restored MPEG-4 video data, the camera video data, and the graphic 
data, or video data where the video data and the graphic data are blended. 

25 [0043] Referring to Figure 5, a method for displaying the restored 

MPEG-4 video data or the camera video data is provided. The multiplexer 205 
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receives digital video data outputted from the camera module 203 and the MPEG- 
4 codec 204. The multiplexer 205 selects one of video data inputted from the 
camera module 203 and video data inputted from the MPEG-4 codec 204, 

[0044] The selection is based on the input video selection signals 
5 outputted from the CPU 201 to provide an output to the video overlay unit 206. 
The digital video data outputted from the camera module 203 and the MPEG-4 
codec 204 is YUV (brightness, color) data (16 bits), and inputted to the CSC unit 
301 thus to be converted into R, G, B data (24 bits), for example. 

[0045] In certain embodiments, the video selection unit 304 selects one 

10 video data based on the output video selection signals (VID_SEL) of 2 bits 
inputted from the CPU 201, and outputs it to the LCD interface 208. Also, the LCD 
interface 208 outputs control signals of a video pixel clock (VCLK), a vertical 
synchronous signal (Vsync), and a horizontal synchronous signal (Hsync) and 8-bit 
video data (one 24-bit pixel data per 3 cycles) to the LCD 209 and thereby displays. 

15 [0046] The color look-up table converts graphic data (16 bits) inputted 

from the CPU 201 into R, G, B data (24 bits). The video selection unit 304 selects 
the graphic data on the basis of the output video selection signals (VID_SEL) of 2 
bits (0.0) inputted from the CPU 201, and outputs it to the LCD interface 208. Also, 
the LCD interface 208 outputs control signals of a video pixel clock (VCLK), a 

20 vertical synchronous signal (Vsync), and a horizontal synchronous signal (Hsync) 
and 8-bit video data (one 24-bit pixel data per 3 cycles) to the LCD 209 and 
thereby displays. 

[0047] In one or more embodiments, the color palette unit 303 receives 
the restored MPEG-4 data outputted from the multiplexer 205 or data which the 
25 camera video data is converted into R, G, B data through the CSC unit 301, and 
receives data which graphic data outputted from the CPU 201 is converted into R, 



G, B data through the color look-up table 302. Advantageously, the color palette 
unit blends data inputted from the CSC with data inputted from the color look-up 
table with a predetermined ratio on the basis of the output video selection signals 
(VID^SEL) of 2 bits (1 .0). / 

5 [0048] Referring to Figure 6, the color palette unit 303 determines a 

blend ratio of the inputted data with a predetermined ratio of a predetermined 
video blend table on the basis of 4-bit video blend signals (B_L) outputted from the 
CPU 201 . Accordingly, the color palette 303 blends video data Inputted from the 
CSC 301 with graphic data inputted from the color look-up table 302 with the 

10 predetermined ratio based on the video blend table, and outputs to the video 
selection unit 304. 

[0049] Preferably, when a bit combination of the video blend signal (B_L) 
is '0,1 ,0,0', for example, a blend ratio of the graphic data is 100% and a blend ratio 
of the video data is 0%. As such, the LCD of the mobile telecommunication 

15 terminal displays the graphic data. When a bit combination of the video blend 
signal (B_L) is '0,1,0,1', for example, a blend ratio of the graphic data is 0% and a 
blend ratio of the video data is 100%. Accordingly, the LCD of the mobile 
telecommunication terminal displays only the video data. 

[0050] In one embodiment, when a bit combination of the video blend 

20 signal (B_L) is '1 ,0,1 ,0'. for example, a blend ratio of the graphic data is 25% and a 
blend ratio of the video data is 75%. Accordingly, the LCD of the mobile 
telecommunication terminal displays the graphic data and the video data In a state 
that the video data is a little overlaid by the graphic data. 

[0051] The video selection unit 304 selects blending data of the graphic 

25 data and the video data on the basis of the output video selection signals 
(VID_SEL) of 2 bits (1.0) inputted from the CPU 201, and thereby outputs to the 



LCD interface 208. Also, the LCD interface 208 outputs control signals of a video 
pixel clock (VCLK), a vertical synchronous signal (Vsync), and a horizontal 
synchronous signal (Hsync) and 8-bit video data (one 24-bit pixel data per 3 
cycles) to the LCD 209. 

5 [0052] In accordance with one embodiment of the invention, the video 

overlay device of a mobile telecommunication terminal according to the present 
invention can overlay graphic data and video data by blending graphic data 
displayed on an LCD screen of the terminal with videos inputted through a camera 
or MPEG moving pictures with a desired ratio. The video overlay device of a 

10 mobile telecommunication terminal displays moving pictures on the entire LCD 
screen of the terminal and at the same time outputs each kind of control icon or 
icon for displaying a state of the terminal by overlaying. According to this, the 
user can appreciate the moving pictures in a wide screen and know information of 
the terminal, thereby having enhanced convenience. 

15 [0053] The embodiments described above are to be considered in all 

aspects as illustrative only and not restrictive in any manner. Thus, other 
exemplary embodiments, system architectures, platforms, and implementations 
that can support various aspects of the invention may be utilized without departing 
from the essential characteristics described herein. These and various other 

20 adaptations and combinations of features of the embodiments disclosed are within 
the scope of the invention. The invention is defined by the claims and their full 
scope of equivalents. 
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